Bivariate Partial Information Decomposition: The Optimization Perspective
نویسندگان
چکیده
Bertschinger, Rauh, Olbrich, Jost, and Ay (Entropy, 2014) have proposed a definition of a decomposition of the mutual information MI(X : Y, Z) into shared, synergistic, and unique information by way of solving a convex optimization problem. In this paper, we discuss the solution of their Convex Program from theoretical and practical points of view.
منابع مشابه
A Note on the Bivariate Maximum Entropy Modeling
Let X=(X1 ,X2 ) be a continuous random vector. Under the assumption that the marginal distributions of X1 and X2 are given, we develop models for vector X when there is partial information about the dependence structure between X1 and X2. The models which are obtained based on well-known Principle of Maximum Entropy are called the maximum entropy (ME) mo...
متن کاملBivariate Copula Decomposition in Terms of Comonotonicity, Countermonotonicity and Independence
Copulas are statistical tools for modelling the multivariate dependence structure among variables in a distribution free way. This paper investigates bivariate copula structure, the existence and uniqueness of bivariate copula decomposition in terms of a comonotonic, an independent, a countermonotonic, and an indecomposable part are proved, while the coefficients are determined by partial deriv...
متن کاملThe Relation between Granger Causality and Directed Information Theory: A Review
This report reviews the conceptual and theoretical links between Granger causality and directed information theory. We begin with a short historical tour of Granger causality, concentrating on its closeness to information theory. The definitions of Granger causality based on prediction are recalled, and the importance of the observation set is discussed. We present the definitions based on cond...
متن کاملEffect of CO2 Partial Pressure on the Thermal Decomposition Kinetics of Zinc Carbonate Hydroxide (TECHNICAL NOTE)
In this work, the effect of carbon dioxide partial pressure on the calcination kinetics of high purity zinc carbonate hydroxide has been studied. Non-isothermal analysis has been performed on samples at different CO2 partial pressures by TGA and DTA. It has been found that the calcination behaviour of this material corresponds to the shrinking core model and the reaction mechanism is phase boun...
متن کاملAccelerated decomposition techniques for large discounted Markov decision processes
Many hierarchical techniques to solve large Markov decision processes (MDPs) are based on the partition of the state space into strongly connected components (SCCs) that can be classified into some levels. In each level, smaller problems named restricted MDPs are solved, and then these partial solutions are combined to obtain the global solution. In this paper, we first propose a novel algorith...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Entropy
دوره 19 شماره
صفحات -
تاریخ انتشار 2017